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Abstract 

We study a system of N particles interacting through the Kac collision, with m of them 
interacting, in addition, with a Maxwellian thermostat at temperature ^. We use two indicators 
to understand the approach to the equilibrium Gaussian state. We prove that i) the spectral 
gap of the evolution operator behaves as ^ for large N ii) the relative entropy approaches its 
equilibrium value (at least) at an eventually exponential rate ^ ^ for large N. The question 
of having non-zero entropy production at time 0 remains open. A relationship between the 
Maxwellian thermostat and the thermostat used in [5] is established through a van Hove limit. 


1 Introduction 


Mark Kac introduced a stochastic model of N identical particles interacting through binary col¬ 
lisions [12]. The particles are constrained in 1 dimension and are uniformly distributed in space. 
Hence, the phase space consists of 1-dimensional velocities v = [vi, ...,V]s[) that evolve when the 
particles undergo random collisions as follows: Two particles i,j are chosen uniformly among the 
(^) pairs, and 9 E [0,27r) is chosen uniformly. The outgoing velocities v* and v* are given by 
Vi cos 9 -b Vj sin 9 and —Vi sin 9 + vj cos 9 respectively, where Vi and Vj are the incoming velocities of 
particles i and j. 

This collision preserves the kinetic energy and hence v lies on the constant energy sphere 
where E, the energy per particle, is determined by the initial condition. The system is modeled 
as a Markov jump process with collision times that are exponentially distributed with mean 
A probability density /(v,t) on the phase space evolves through the corresponding Kolmogorov 
forward equation, called the Kac master equation: 

^ = NX{Q-I)f (1) 

Qij is the Kac operator with 

i<j 

r27r 

Qijf = -f f{...,Vi cos 9 + Vj sin 9 ,..., —Vi sin 9 + Vj cos 9 ,...) d9 

Jo 
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where Q = 

V 2 j 
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The unique equilibrium state is the uniform distribution on the sphere. 

In his paper, Kac precisely formulates Boltzmann’s Stosszahlansatz (molecular chaos hypothesis), 
which says that for a dilute gas in the large particle limit, the incoming velocities of colliding parti¬ 
cles are uncorrelated. Kac proved for his model that this property propagates in time. This notion, 
now known as “propagation of chaos”, enabled him to rigorously derive a space-homogeneous 
Boltzmann equation for his model [12] (see also m)- In fact, one of Kac’s motivations was to 
study approach to equilibrium for the Boltzmann equation using the linear N particle master 
equation m- In particular, Kac conjectured that the spectral gap of NX{I — Q) is bounded be¬ 
low, away from 0, uniformly in N. This was proved by Janvresse m and the exact gap was 
found by Carlen, Carvalho, and Loss in [3| and independently by Maslen M- It follows from 
their work that \\f{v,t) — 1||2 < e“ 2 *||/(i;,0) — 1 || 2 , where f{v,t) satisfies ([I]), and the norm is in 
L^(S''^-i(\/ NE), da), where da is the normalized uniform measure on the sphere. 

It turns out that the relative entropy ^(/ll) = f f log f da, being an extensive quantity, is a more 
favorable measure of distance to equilibrium in the large particle limit. For the Kac model, entropic 
approach to the equilibrium at an exponential rate of order ^ is shown by Villani in m- This rate 
was shown to be essentially optimal near t = 0 by Einav in [^, by constructing states in which a 
macroscopic fraction of the kinetic energy was contained in a fraction ~ of the particles, for 
a > 0 suitably chosen. 

The Kac model coupled to a heat bath was studied in [2|, where they explored the possibility of 
obtaining better entropic convergence by remaining close to physically realizable initial states. To 
this end, they considered a system of N particles where, in addition to the Kac collision among 
them, each collides with a reservoir modeled as an infinite gas in thermal equilibrium. This resulted 
in a system in which all except a relatively small number of particles are in equilibrium. Exponential 
convergence to the canonical equilibrium at a rate of ^ was proved, where ^ is the strength of the 
thermostat. Note that since the energy of the N particles is not conserved in the presence of a heat 
bath, the phase space becomes M'^. 

In this paper, we take the model in [2] but let only m < N of the particles be thermostated, and 
use a simpler model for the thermostat: the Maxwellian thermostat given by ([3]). (We will refer 
to the Maxwellian thermostat as the strong thermostat, and to the thermostat used in [2] (see 
([9]) ) as the weak thermostat.) The motivation for our study is two-fold. Eirst, studying partially 
thermostated systems is a step towards introducing spatial inhomogeneity in Kac-type models, by 
viewing the m thermostated particles as situated “closer” to the heat bath. These m particles 
act as the medium of heat exchange between the other particles and the reservoir. Second, the 
convergence to equilibrium in [2] persisted even without the interparticle interaction, which did 
not play a role in the slowest decay modes. By thermostating only a subset of the particles, the 
interparticle interaction become necessary for the system to approach the canonical equilibrium 
and hence their role can be better understood. Using the spectral gap, we show that (strongly) 
thermostating a macroscopic fraction of particles i.e. m = aN guarantees approach to equilibrium 
in the distance uniformly in N. We also obtain a weaker convergence result in terms of the 
relative entropy of the system. 


Description of Model and Results 

We have N particles interacting via the Kac collision, with m among them interacting, in addition, 
with a Maxwellian thermostat at inverse temperature [3. We fixAI>2, l<m<A^ (The case 
m = N has been studied in [2|, using the weak thermostat.) When particle k G {I,...,m} is 
thermostated, it forgets its precollisional velocity Vk and is given a new velocity from the Gaussian 
distribution at the temperature of the heat bath. Physically, this could model the behavior of 
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a particle colliding a large number of times with particles from the heat bath. This can also be 
thought of as a particle in the system being replaced with one from the heat bath. 

The collision times with the heat bath for particles {1,... ,m} are independent and exponentially 
distributed with parameter /x. The master equation for the evolution of a phase space probability 
density /(v,t) is given by 


dt 


iVA(Q-/)/ + /x^(i?fc-/)/ , 

k=l 


(2) 


where the operator 


Rkf:= 



j dwf {vi,V2, ...,Vk-l,W,Vk+l, ■ ■ ■,vn) 


( 3 ) 


corresponds to the thermostat acting on the k-th. particle. Recall that phase space is since 
our system is non-isolated and energy is not conserved. We assume that the particles 1, 2,... , m 
and the particles m + are indistinguishable, i.e. /(v, t) is symmetric under exchange of 

variables vi,... ,Vm and under the exchange of variables Vm+i ,..., uat. The evolution preserves this 
symmetry. The interplay between the thermostat-interaction and the Kac collisions that distribute 
the energy to the non-thermostated particles lead the system to equilibrium. 

As we will see, the unique equilibrium of eq. ([ 2 ]) is the Gaussian 


N 


7(v) := Ylgivk) 


k=l 



k=l 


The evolution operator in eq. (I2D is not self-adjoint on and to this end we make the 

ground-state transformation 


/(v) =7 (v)(1-F/i(v)) , 


where f hj = 0. The evolution equation for h(v, t) becomes 


— = NX{Q-I)h + fiY,iPk-I)h , 

k=l 


( 4 ) 

( 5 ) 


where 


Pkh := j dwg{w)h{vi,...,Vk-i,w, Vk+i, ...,vn) 

is a function independent of In the Hilbert space L^(]R^, 7 ), the operators Pk, Q and hence 
PN,m ■= NX{I — Q) + g — Pk) associated with the evolution, are self-adjoint. In fact, each 

Pk is a projection. 

The rate at which h tends to its equilibrium value 0 in the space , 7 ) is given by the spectral 

gap Ajv,m (see (fT^ ). Theorem 12.21 states that Ajv,m ~ ^ for large N. It turns out that the kinetic 
energy K{t) := f also behaves similarly for large N. More precisely, K{t), which 

is not conserved since the A-particle system is not isolated, tends to its equilibrium value ^ at a 
rate ~ S when N is large. 
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Remark. The behavior of the kinetic energy is indicative of the action of the operator CN,m on 
polynomials of the form Vj. Moreover, for N = 2,m = 1, we show in Appendix |A] that the gap 
eigenfunction - the slowest rate of decay in the space - is a second degree polynomial. 

One may thus wonder if the gap eigenfunction is a second degree polynomial for other values of N 
too. However, currently we only have asymptotic bounds on Ajv,m- 

Next, we study the behavior of the relative entropy S{f\'y) (defined in (l28]l b To obtain a quanti¬ 
tative rate for the decay in the relative entropy (we use the opposite sign for the relative entropy), 
one could try to prove Cercignani’s conjecture [6] applied to our system: 

-Ah^>*5(/(.,0)b) (6) 

for some k > 0, which would yield an exponential bound 

5(/(.,t)|7)<e-^‘5(/(.,0)|7) 

for the entropy. The quantity — ^ is called the entropy production. Parenthetically, note that the 
spectral gap imposes a condition on how big k can be: linearizing Q and comparing lowest order 
terms gives 


k < 2AN,m. (7) 

For our problem, finding a bound for the entropy production appears to be hard because the familiar 
methods to obtain such estimates fail (we demonstrate why at the end of Section 11. Instead, we 
show in Theorem KT\ that the entropy at time t satisfies 




where is the solution of (H with initial condition /(.,0) and 




(^+-5- ^ 5+-5.) • 


( 8 ) 


For large N and t, ~ exp(— t). Note that (H is weaker than ([6]). For instance, 

([I does not yield an entropy production bound at time 0, since D '^= 0. We prove the 
Theorem by employing the convexity of S{f\'y) directly. The idea is similar to a method used in 
[2] to study the entropy of a particle acted on by the weak thermostat. 

The generator U of the weak thermostat is defined as follows: 


/ r2n 

dwj- d9f{v cos 6 + w sin 9)g{—v sin 9 + w cos 9) 


where g{v) 



The following entropy decay bound for the process is shown in [2]: 


(9) 


S{e^^^-^^^f\g)<e-^^/^S{f\g), or 


( 10 ) 


dt ~ 



( 11 ) 
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As an aside, we show in Appendix [B] that the bound in m is optimal by using an optimizing 
sequence similar to that used in miaE]. 

One can interpret the weak thermostat as a particle interacting with an infinite heat bath at 
temperature ^ via the Kac-collision. The velocity distribution g{v) of the particles in the heat bath 
is not affected by the collisions by virtue of the infinite size of the bath. This picture shows why it 
is weaker than the strong thermostat: In order for a particle from the system to forget its incoming 
velocity and pick a new one from the distribution g{v), it has to undergo a large number of weak- 
thermostat interactions. The strong thermostat achieves this in one step ([3]). Although the weak 
thermostat mimics heat bath interactions more naturally, the strong thermostat is advantageous to 
use as a first step since the corresponding operator is idempotent and thus mathematically simpler. 
Moreover, we demonstrate in Theorem 13.11 that the weak thermostat can be obtained from the 
strong thermostat via a van Hove limit. 

The paper is organized as follows: We show approach to equilibrium in in Section O compute 
the van Hove limit in Section [31 and show approach to equilibrium in relative entropy in Section SI 


2 Approach to equilibrium in L?‘ 

From this point on, we set /? = 1 without loss of generality. 

In concurrence with the ground-state transformation ([3]). let Aat := {u G : {u,l) = 0}, 

where (.,.) denotes the inner product in the space with weight 7 . The condition (u, 1) = 
f u(v)j(v)dv = 0 corresponds to the normalization of the probability density /. 

Lemma 2.1. 


• ^N,m > 0 on Atv. 

• ^N,mh = 0 /l = 0. 

Proof. We know from that {I — Q) > 0 and (/ — Q)h = 0 <t7 /i is radial. Each (/ — P^) is a 

projection with kernel precisely the subspace of functions in that are independent of Vk- The 
only function in Ajv that belongs to the kernel of ~ ^k) and is also radial is 0. Hence, the 

Lemma is proved. □ 

The spectral gap of the operator CN,m is defined as: 

^N,m. := ini{{h,CN,m[h]) : | |/i| | = 1,/i G Xn} ■ (12) 

Lemma l2 .1 1 implies that initial states in Ajv decay to equilibrium at an exponential rate ^N,m- 

Remark. Gaussian states of temperature greater than twice the temperature of the heat bath 
cannot be represented by a function h G A^r. 

The observation that T 2 ,i is simply a linear combination of two projections {Q = Q 12 is an or¬ 
thogonal projection onto radial functions in M^) lets us compute the whole spectrum in this case. 
This is done in Appendix O We see that the spectral gap is the lower root of the quadratic 
— (2A -I- g)x -|- A/r: 


2 ^ 2,1 


(2A -\- jj.) — \l 4A^ -|- [if 
2 


(13) 
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with gap eigenfunction 


2A 

2A + /i — A 2 P 


H2{v2) 


■H2{vi) + 


2A 


2A - A 


2,1 


where H 2 is the monic Hermite polynomial (with weight 7 ) of degree 2. 
For general N, m, we have the following theorem: 

Theorem 2.2. Assume A,/i > 0. Then 


m 


N -I 


A2,1 < 


^N,m ^ 


m 2A/i 
A — 1 + A 


(14) 


Proof. The proof is based on an inductive argument that follows in essence the one in [3] in which 
the spectral gap of the Kac model is computed exactly. We first prove the following claim for 
1 < m < A: 


^N,m > - ]\[ _ I -l,m —1 • (15) 

We let be the evolution operator CN,m with the k particle removed: 

^ 2 ^ i^j i=i 

b J ^ k l^k 

Remark 2.3. is also self-adjoint in L^(M'^, 7 ), and will have m or m — 1 thermostats in 

it, depending on whether k > m or k < m, respectively. Also, the coefficient of the Kac term 
corresponds to collisions among A — 1 particles. 

Next we show that 


Aat, 


m 


1 


A- 1 


Ak) 


This follows, since 


(16) 


/ \ 


N 

N 

2A 

A- 2 

N 

m 

SA Ak) 

/ . ^N,m 

= E 

E 


k=l 

fc=i 

i < j, 

1 = 1 



V 

hj + k 

l^k y 


N m 

= 2A^(/-Qi,) + (A-l)^^(/-P0 

i<j 1=1 

= (A - l)CN^rn- 


Then 
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{h,CN [h]) 


1 


(17) 


N -1 


N 




At this point, we want to introduce the gaps A^-i^rn and A 7 v-i,m-i for N—1 particles into the right 
hand side; for this, we will need the functions to be orthogonal to 1 in the space 7 ( 1 )^)), 

where 'y{vk) is the Gaussian 7 with the variable missing. To this end, we define the projections 


TTk[h] := 


hjivk) dvi... dvk-idvk+i ■ ■ ■ dvN 


and write, for each k, (/i, = {{h — TTkh), — vrfc/i)). This holds because the range of 

the projection tt/c is exactly the kernel of and the operator is self-adjoint. Thus, from 


(ED, 


Aat,™ = 

k=l 

where the infimum is over h G A^r, ||/i|| = 1 as per the definition of the spectral gap. Since (/i —vr^/i) 
is orthogonal to the constant function 1 in 7 ( 1 )^)) by construction, we use the definition 

of the spectral gap to write 


A 


Remark [A 


/TV m \ 

> ^ inf f ^ AN-i,m{\\h-Trkh\?) + '^^N-i,m-i{\\h-Trkh\?‘) \ (by 

\fe=m+l k=l J 

( N m \ 

— inf(A7v_7m (||/i||2 - ||7rfc/i||2) + Ajv-i,m-iX](ll^ll^ “ ll^fc^ll^) ) 

\ fc=m+l k=l / 

1 ^ 

Ti TTl 1 r A A T II 7 112 

^AAr_i^m + Aat,! 1 iV-l ,m-i Ajv—i^m.— 11 sup y ^ \ |7rfcn.| I , 


A-] 

N — m 


N - 


where we have used symmetry among 1 , ...,m and m -|- 1 ,..., A and the fact that the infimum is 
over functions with norm 1 . 

First, we note that Ajv—i,m ^ AAr_ 7 m-i since {I - Pm) > 0. Next, sup{X)^i IKfc/i|p,/i € 
Aat} equals sup;YN{h,Ylk=i'^kh). Since {T^k}^ is a collection of commuting projection operators, 
is a projection and the supremum is 1 . 

We then get 

N—m ni A i- A 

AWjm ^ ^AjV—l,m + N-l ^ ^ Aw-pm, 

which implies claim (I15p . 

We now prove the first inequality in Theorem 12.21 The region of interest is {(A, m) : 1 < m < 
A — 1}. We will use induction on A > 2. 

• The base case A = 2, m = 1 is the trivial statement A 2 ,i > A 2 ,i. 

• Now suppose 

TTl 

AN,m > ^ 2,1 jy _ (i-^) 
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for all m such that 1 < m < N—1. To show that A7v+i,m > ^ 2 , 1 ^ for all m such that 
1 < m < N, consider the following two cases: 

-k m = 1: We need to show that Aat+i^i > From (fT^ . we deduce that 

A 1 A 1 A 1 A 

Atv+i,! > ^ An,1 + ^Atv^o = ^ Aat^i . 

In the above, we have Aat^q = 0 because when none of the particles are thermostated, 
the ground-state is degenerate (any radial function in is an equilibrium for the Kac 
part). Applying p8|) with m = 1 then completes the proof of this case. 

* 1 < m < A: 


AjV-|-l,m ^ 


N—m /mA 2 ,i\ m / (m—l)A 2 ,i 

I A- 1 j A V A- 1 


A 

= A2,1 


(using (fTCjl and (USD) 


—;--(A — — 1) = A 2 i — 

A(A-l)^ ^ ’A 


This proves the first inequality in (|14p . We prove second inequality in (|14l) . by finding an upper 
bound proportional to 7 ^^, for l^N,ra- This can be done by finding a (possibly crude) upper bound 
on the eigenvalues of CM,m on the space of second degree Hermite polynomials with weight 7 . 
This space is invariant under CN,m and its action on it with basis {Ylik=m+i H2{vk),YJJ^=iH2{vk)] 
can be described by the following matrix (as mentioned before, this is related to the evolution 
of kinetic energy of the system). We use the identities QijH 2 {vi) = {H 2 {vi) + H2{vj))/2 and 
QijH 2 {vk) = H 2 {vk) foi i,j ^ k in obtaining the entries. 


Am 


—Am 


N-1 N-1 

X{N—m) X(N—m) , 
N-1 N-1 


Its smallest eigenvalue is |(/r + 7 ^^)(l — ,/l — ^(^7 - 75 x 77 )- Hence, by definition of the gap, 

h- ^ 


A 1 / NX 

N.N,m < 2 ^ A — 


For A large enough, we can write 


1 / NX \ m 4A^ 

- 2 (f* + jvxij 


or 


AjVjm ^ 


m 2A/i 
A — 1 ;U + A 


□ 

Thus, as we are close to equilibrium, /i —>■ 0 in at an exponential rate Ajv,™,) which for 

large A, is proportional to the fraction of thermostated particles. 
























3 van Hove Limit 


In this section, we relate the strong and weak thermostats by studying the two-particle system 
{N = 2, m = 1) described by eq. ([2]): 


dt 






(19) 


Here the superscript makes it explicit that the solution depends on A. 

Particle 2 interacts through the Kac collision with Particle 1, which is given the Gaussian distribu- 
tion g{v) = J ^ at random times due to the action of the strong thermostat Ri. We increase 
the rate /r at which the strong thermostat acts relative to the rate of the Kac collision 2A. This can 
be achieved by increasing the time scale of the Kac operator ^ ^ oo and sampling at longer time 
intervals r := tX. Thus, the thermostat, operating on a much smaller time-scale, becomes powerful 
in the limit. The result is that by passing through a van Hove (weak-coupling, large time) limit 
[ 8 ] of this system, Particle 2 gets thermostated “weakly”, via its interaction with Particle 1 whose 
distribution is essentially always g{v). 

We are interested in the evolution of /'^(ui,U 2 ,t) := f^{vi,V 2 ,j) in the limit A —>• 0. Here 
satisfies (fT9l) above. The equation satisfied by /^(ui,U 2 ,t) is then: 


^ = -2(7 - Qi 2 )/^ - j{I - Ri)f^ =■■ -y( 20 ) 

We have the following theorem, which states that the diagram in Figure 1 commutes. 

Theorem 3.1. 


Let satisfy eq. ([20]) with initial condition f^{vi,V2,0) = (j){vi,V 2 ) G L^(M^). Then for r > 

0 , lim =: g{vi)f{v 2 ,T) exists in where / satisfies the equation 

A^o 

= _2(I - U2)f (21) 

together with the initial condition f{v2,0) = • ^2 is the weak thermostat ([9]) acting on V 2 - 


(t){vi,V2) 


e 


f^{vi,V2,T) 


Ri 




A ^ 0 


9i'^i)hv2,0) givi)fiv 2 ,T) 


Figure 1: van Hove Limit 


Proof. We can write e = I + {I — Ri){e — 1) because (/ — Ri) is idempotent. This 

implies that 


- 7?i||i = e"'^A||/ - < 2e"^A. 


( 22 ) 
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For each A, the operators in are bounded. Thus, the Dyson expansion (the infinite series version 
of the Duhamel formula) corresponding to the evolution in ([20l) gives 4> = YlT=o ^k{4‘) where 


6o((^) = e 

= [ e-x(^-«i)(^-*i)[- 2 (/-Qi 2 )]e-x(-f-^i)‘i</, dti, and 

Jti=0 

J{0<tk<-ti<r} 


Using ([22]) and the identity R 1 Q 12 R 1 = R 1 U 2 = U 2 R 1 , we show that Vfe, bk{4>) converges to 
[ Ri[-2{I - Qi2)]Ri ... [-2(1 - Qi2)].Ri<^ dt = i (-2(1 - (Ri^) 

in as A —?■ 0. 

Finally, we use the fact that for each tt > 0, = ||(/>||i and ||(/ — Qi 2 )(l)\\i < 2||i;f)||i 

so that \\bki(p)\\ < ■ ■ ■ dtk\\4>\\i = independently of A. Therefore the 

dominated convergence theorem can be applied to give 


lim e A® (A 
A^o 


00 00 

lim V6fc(</>) = lim 6fc(0) 

fc=0 k=0 

00 ^ 

Y{-2{I - U2)Y-^{Ri4>) = 

fe =0 


□ 

The above proof can be generalized to give the following van Hove results for the A^-particle case. 
We will use the statement “the van Hove limit of {H(A) : A > 0} as A —?■ 0 is H* with idempotent 
operator H” to mean lim;),^o e“A^(U^ = {Bcj)) = (f> for all r > 0 and all 4> G L^. 

• The van Hove limit of {A^^ 2 (-^ “ Qij) + ~ acting on L^(R^), is Ylf= 2 i^ ~ ^j) 

with idempotent operator Ri. 

• The van Hove limit of {A^A(/ — Q) + n{I — Ri)}, acting on L^(M-^) is Ylf= 2 i^ ~ ^j) + 

(-^ — 1)(-^ — with idempotent operator i?!. Here = jftj 2 '^ 2 <i<ji^ ~ Qij) is the 
Kac operator acting on particles 2,... ,N. 

• Let a = ^rp- The van Hove limit of {Aa2A^(I — Q{ 2 N)) + I^Y^=N+ii^ ~ ^i)}^ acting on 

^i(]^ 2 W), -g ~ with idempotent operator Rn^iRn +2 ■ ■ ■ R 2 N- 

Here Q(Ar) and Q(^ 2 N) are the Kac operators acting on particles vi,... ,vn and ui,... ,V 2 n 
respectively. 

The first two results show that having one strongly thermostated particle is sufficient to “weakly” 
thermostat each particle colliding with it in the van Hove limit. The strength of this thermostat 
will be 0{^) under the usual Kac collision unless ~ N strongly thermostated particles are used, 
as in the third result. 
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Remark 3.2. The third result shows that up to a constant in the thermostat terms, it is possible 
to obtain the model in [2] as a van Hove limit of models in which half the particles are strongly 
thermostated. 


4 Approach to Equilibrium in Entropy 


In this section, we study the behavior of the relative entropy functional 

‘S'(/|7) := J flog^dv 


(23) 


under the evolution ([2]). This is a standard way to track the approach to equilibrium since it 
satisfies S{f\'y) > 0 and ^(/ly) = 0 / = 7 . For our model, we show below that ^ 0 

as t ^ 00 , provided the initial distribution /(., 0 ) has finite relative entropy. 

Set f = 'jh (this is slightly different from the ground-state transformation (H])), and restrict to 
h > 0, f h'ydv = 1. The evolution equation obeyed by h{v,t) is eq. (I5|), which we restate below: 


'm 


NX{Q -I)h + ^i ^{Pk - I)h = -CN,mh 


k=l 


The relative entropy then becomes f hlog hj dv, which we denote by S(h) (overloading the nota¬ 
tion) for the remainder of this section. 


Now, 


dS fdh fhdh f^h 


where the second term vanishes because the normalization / /17 dv = 1 is preserved by the evolution. 
Hence, 

^ = I (^NX{Q-I)h + ^i'^{Pk-I)h^ logdydv. 

We know (from [12]) that f N{Q — I)h\ogh^dw < 0. Also, 

J Pkhlogh^dv = J Pkh Pk{logh)jdv (by self-adjointness of Pk as observed in Section [ 2 |) 

< Jim log(P./.) 7 <iv (by concavity of log and averaging property of 
</Mogl.ydv (by convexity of n logy) 


Pk 


dt 

evolution 


Thus < 0. The following theorem indicates how fast the relative entropy decays under the 


Theorem 4.1. Assume 1 < m < and let h{'v,t) be the solution of ([5|). Then we have that 

S(h(v,t)) < 1 -^^ + ^(Mv,0)) (24) 


where = d±(N,m) = ± “ 4mXfi/(N - 1)) . 
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We first state a few observations on the above bound. Let us define 


S-e '^+* ^ J+e 

< 5 + - < 5 _ ^ ( 5 + - < 5 _ ■ 

As expected, D{t) is identically equal to 1 when A or is 0. For A,/x > 0, lim D{t) = 0, D{t) is 

t^OO 

equal to 1 at i = 0 and it is a decreasing function of t > 0. The last claim can be seen by computing 



dlD S _<5-1- / A F A +\ 

^ = V-V(e" + - e" ) < 0 

dt (5_|_ — ^ ^ 


(25) 


since S- < (5+. For large t, the dominant term in the bound (|24p is e and for large N, 
(5_ ~ • Hence, we obtain an eventually exponential decay of relative entropy through 

this bound, albeit with decay constant ~ 

In this paragraph, we make a few remarks about the bound for the special case = 2,m = 1. 
Observe that d_(2,1) = A 2 ,i is the spectral gap of 2X{I—Q)+fj.{I—Pi) (see (fT^ i. As an aside, note 
that this is in accordance with ([7]). Upon making the transformation (^, A) —)• {j, 1) corresponding 
to the van Hove limit (see eq. (I20]l i. we obtain D{t) as A —)• 0. This is exactly the optimal 

entropy production bound (jlOp for the weak thermostat (Note: the weak thermostat here appears 
with a factor of 2, owing to the 2A term). 

The Theorem is proved as follows: we write /i(v, t) explicitly in terms of the exponential of the 
generator of the evolution, expand the latter using the Dyson series and use the convexity of the 
entropy. We exploit the entropic contraction of terms of the form PjQ in the expansion. These 
steps will yield a non-trivial bound for the entropy at time t in terms of the initial entropy. 

The following lemmas build up to the evolution operator in steps. For instance. Lemma [4. 2 1 

bounds some of the terms obtained by decomposing the Kac operator in the expression S{PiQh). 
Throughout, we assume that h E and h>0. 

Lemma 4.2. We have 

^ 1 

Y,S{PiQiih)<{{N-l)--)S{h) 

i=2 


Proof. In the following proof, we will apply the continuous version of Han’s inequality [lU] (this also 
follows from the Loomis-Whitney inequality m) for the entropy rewritten to suit our situation: 


N 

^S{P,h)<{N-l)S{h) 


(26) 


Note that if h is symmetric in its arguments, this amounts to saying that for each j = I, ..,N, 


S{P,h) < ^^S{h) 


(27) 


For j > 1, 


S{PiQijh) 


j PiQijhlog{PiQijh) ydv 

/ + / p^QyhiogiPiPjh) -fdv 
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where we use that PiPjh does not depend on t>i. Since the argument of the logarithm in the last 
term is also independent of Vj, we can integrate PiQijh with respect to those variables and use 
that f PiQijh g{yi)g{vj)dvidvj = f h g{yi)g{vj)dvidvj = PiPjh to write: 


S[PiQi,h) = I P,(^^)log{P,{^^))P,P^hjdv + I P,P,hlog{PiPjh) 7 dv 

Now, we apply the symmetric version of Han’s inequality (f271l to as a function of ui and vj 

to get: 


S{PiQijh) <^J ;^^log(-^^)PiPj/i7dv + J PiPjhlog{PiPjh) 7dv 

= ^S{Qijh) - ^ J Qij/ilog(PiPj/i) 7dv + J PiPj/ilog(PiPj/i) 7dv 

= ls{Qi,h) + ls{P,Pjh) 

where, to get to the last step, we have used that Qij is self-adjoint and PiPj is independent of vi 
and Vj. 

Now, summing these terms, and noting that S{Qijh) < S{h) by the averaging property of Qij, we 
get 

^ N-^ 1 ^ 

SiPiQyh) < -^S{h) + - ^ S[PjP,h). 

i=2 j=2 

We invoke Han’s inequality ([26]) on Pih = {Pih){v 2 , ■■■vn), ie. ^f =2 S{PjPih) < (N — 2)S{Pih) 
{N — 2)S{h) to complete the proof. 

Lemma 4.3. 

Proof. 

= S{e~^^Qh + (1 — e~^^)PiQh) (since Pi is a projection) 

< e-^^S{Qh) + (1 - e-^^)S{PiQh) 

< e-^^S{h) + (1 - 5(PiQ,,P) 

I 2 J i<j 

1 ^ 

= e-^*5(/.) + (l-e-^*)^( S{PiQ,,h) + Y,S{PiQijh)) 

V2l j=2 

<e-i“S{h) + (l-e-i“)P{ S(/>) + (iV - 1 - i)S(/!)) 

V2j 

= (‘- V(^) 

where we use Lemma 14.21 in the last inequality. We use the convexity of the entropy and the 
averaging property of Pi and Q in the previous steps. □ 
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VI □ 










Lemma 4.4. Let 1 < m < N. Then 

s(^exp(^^ep{P,-I)t)^Qh^ < (^1 - 5(/i). (28) 

Proof. We prove the above by induction on m. The base case m = 1 (and any > 1) was shown 
in the previous Lemma. We restrict to {(A^, m) : 2 < m < Ai} for the rest of the proof. Assume 
that the Lemma is true for m — 1 (and any N > m — 1). To infer from this its validity for the 

case m (and any N > m), we analyze below the entropy of Pm exp (^hYlT=i where we 

expand the Kac operator Q, split it into terms that contain m and those that do not, and utilize 
the convexity of the entropy. 


m—1 


( 


S I Pm exp [n^{Pk - I)t)Qh j < (1 - —)S 


k=l 


exp {TTJk=i{Pk- I)t) 


\ 


\ 




^ ^ QijPmh 


i<j 


/ 


^ 2 \ 
\ J 


In the first terrcH, we also use the commutativity of Pm with Qij when neither i nor j equal m. 
Next, we treat the terms as follows: 

• Term 1: We apply the induction hypothesis for m — 1, N —1 since Pmh is a function of A^ — 1 

variables and Qij is the Kac operator acting on Ai — 1 variables. 

i<j 

• Term 2: We use the averaging property of exp {hYl^=i{Pk — convexity, and Lemma 

sa 


We obtain 

5(Pmexp {fi'^iPk - I)t)Qh) < (1 - ^) (^1 - (m - ~ ' 

(29) 


Now starting with the left-hand side of (f28|) and using convexity plus the fact that Pm is a projection, 
write 


k=l 


’)-i 


m—1 


S exp {fiY^iPk - I)t)Qh =5 (e-^'j + (1 - e-^')Pm) exp ^ (P^ - I)f)Qh 


k=l 


< e-PS 


/ m—1 

I exp E ( 




{Pk-I)t)Qh 


k=l 


+ {l-e P)S ^Pm exp (^ ^ (Pfe - I)t)Qh^ 


^This term is non-zero only when N > 2, which is the case here. 
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Using the induction hypothesis for the case m — \,N for the first term, and the bound (I29p for the 
second term, the Lemma follows through some algebraic simplification. 

□ 


In the following, denote A{t) := 1 — 


Proof of Theorem \4-l\ Expanding e using the Dyson series with Q as the perturbation: 

^N\{Q-I)t+iiY.kiPk-I)t = ^-NXt^NXQt+tiY:{Pk-I)t 


Jo 

+ [ dti dt2 N\Q + ...} 

Jo Jo 


Therefore, using the convexity of entropy, and Lemma 14.41 

S{h{.,t)) < (^1 + NxJ^ dtiA{t - ti) + {NXf dh dt2A{t - ti)A{ti - ta) + S{h{., 0)) 


= e 


„-NXt 


(1 + NX{A * 1) + (1VA)2(^ * ^ * 1) + ...) S{h{., 0)) 


where * is the Laplace-convolution operation. Thus we have that 


(30) 


where ip is defined through the series above. We compute (p{t) using its Laplace transform <^(s). 
Then: 

^ OO 

^(s) = - ^(IVAi(s))^ 

^ k=0 

where ^(s) = ^ — — sT/i) Laplace transform of A{t). 

Summing the geometric series (the sum converges if we assume, for instance, that (p{s) is defined 
on the domain s > NX), 


-/ \ _ _ s + p _ 

- s^ + (p- NX)s - NpX{l - j^) 

The inverse Laplace transform of the above is 

§_^(NX-S+)t ^_^g(7VA-5_)t 

^{NX + /x)2 - AmXp/iN - 1) ^ ^{NX + p)^ - AmXp/{N - 1) 

Now we invoke the uniqueness of the Inverse Laplace Transform: No two piecewise continuous, 
locally bounded functions of exponential order can have the same Laplace transform (see e.g. [Zl)- 
Since ip{t) (see eq. (1301) 1 belongs to this space, we get 


ip{t) = 


^_^{NX-S+)t 

^{NX + - 4mXp/{N - 1) ^ 


^^g(7VA-5_)t 

y/{NX + /x)2 - 4mXp/{N - 1) 


Plugging this into (fSOp . we obtain the desired result (pl|l . 


□ 
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Remarks. 


• From ([25]) . one notices that ^|t=o = 0- This implies, in particular, that Theorem 14.11 does 

not give us a bound like ([6|) on the entropy production. This results from the fact that the 
significant bounds used in the proof, from Lemma 14.21 required the presence of the second- 
order term — I)Q- Note that < 0- 

• The main bound (Lemma 14.2|) was obtained by estimating terms of the form S{PiQijh), and 
we ignored any possible contribution from many other terms e.g. S{QijQkih). Thus, there 
may be scope for a better bound. 

• In particular, we hope to obtain an entropy decay rate that scales as ^ (as we had for the 
spectral gap). We were able to obtain a decay rate scaling as for a modified model: a 
system of N particles where one of them is thermostated (through a Maxwellian thermostat) 
and the Kac collision interaction is replaced by the (much stronger) projection onto radial 
functions. Thus, the role of the Kac interaction in the equilibration process needs to be better 
understood. 


Finally, we demonstrate why it is not easy to find an entropy production bound in our problem. 
Consider the case N = 2, m = \ with A = ^, /U = 1. Here, one could write 


dS{h) 

dt 


Pi h log /lydv -|- 


/ 


Qh\og h'yd'v — 2S{h) 


< 


Pi/ilogPi/iydv -|- 


Qh log Qh'yd'v — 2S{h) . 


We use in the last step that Pi, Q are projections and logx is concave. Bounding this from above 
by —kS{h) (for some k > 0) would be sufficient to obtain an entropy production bound. This idea 
has worked, e.g., for a sum of mutually orthogonal projections like strong thermostats acting on 
different particles. However, in our case, we can find, for every e > 0, a density Le such that 

f Pihjog Pihejdv + f Qh Jog Qh^jdv ^ ^ 

S(hJ - ' 


The idea is to take h proportional to the characteristic function of the set [—a, a] x [P — a, P -|- a]. 
As P —>■ oo, the ratio above asymptotically approaches the value 2. The intuition behind this 
construction is that as P ^ oo, /i is supported approximately in the intersection of the supports 
of Pih (a “band” of width 2a parallel to the vi axis) and Qh (an annulus around the origin). It 
is the tangential nature of this intersection that precludes the application of Han’s inequality [TO] 
to improve the bound S{Pih) + S{Qh) < 2S{h). We are not, however, ruling out the possibility of 
using a different method to obtain an entropy production bound. 


5 Conclusion 

Our results imply that if a macroscopic fraction of particles is thermostated, the kinetic energy and 
the norm decay exponentially to their respective equilibrium values at a rate independent of N. 
However, our entropy bound (I24I) yields a decay rate that vanishes as in the thermodynamic 
limit. Hence, at least under a suitable class of initial conditions, we think it should be possible to 
improve ()24j) to reflect the physical situation. 

The question of entropy production at t = 0 (and any N) remains unsettled. The bound (l2T)l does 
not preclude the possibility of zero entropy production at time 0. However, we do not know if it 
actually occurs in the model for some initial conditions. 
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One could wonder how the notion of propagation of chaos (which was the main motivation behind 
the formulation of the Kac model) adapts to our situation. When m is finite, the coupling to the 
heat bath becomes insignificant in the thermodynamic limit. On the other hand, when m = aN for 
some a < 1, preliminary calculations indicate that in the limit, a coupled Boltzmann equation sys¬ 
tem should result. The Stosszahlansatz needs to be reformulated in a precise manner to account for 
different distributions of the thermostated and the non-thermostated particles. Moreover, general¬ 
izations of our model could bring about connections to previously studied thermostated Boltzmann 
equations [5]. 

Lastly, the results in Section [3] suggest that it should be possible to extend our analysis to the case 
of systems partially coupled to the weak thermostat. 
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A Appendix: Spectrum of Evolution Operator for A = 2, m = 1 

We analyze the spectrum of the self-adjoint evolution operator £ 2,1 = 2A(/ — Q) + fJ-{I — Pi), in 
the space 7 (v)dv), and deduce its spectral gap stated in (fT^ . For simplicity, we denote the 

operators £ 2,1 and Pi by £ and P. 

Notice that £ is a linear combination of two projections (Q = Q 12 is an orthogonal projection onto 
radial functions in M^). The condition {h, 1) = 0 corresponding to the normalization of / = 'y{l + h), 
the leads us to work in the space of Hermite polynomials {Ha{v)}^^Q with weight g{v). The space 
of interest T ’2 is spanned by {Aj : i,j G N, (z,j) / (0,0)}, where Kij := Hi{vi)Hj{v 2 )- Without 
loss of generality, we work with monic Hermite polynomials. 

The action of P is as follows: 


PK^,l = 


0 : z 7^ 0 

iLo,j ■ i = 0 


Since each term in Kij is odd in either ui or V 2 when either i or j is odd, we have that QKij = 0 
when either i or j is odd. We deduce the action of Q on K 2 ai, 2 a 2 from its action on using 

the following Lemma from [ 2 ], which applies to Q as it is a projection onto radial functions. 

Lemma A.l. Let A he a self-adjoint operator on L^(R^, 7 (v)(iv) that preserves the space P 21 
of homogeneous even polynomials in vi, ...,vn of degree 21. If 


we get 

AiH2ai{vi)...H2aj^{vN)) = ^ C;3,.../3jv^2/3i (^^l)---^^2/3jv (^’Af) ■ 

Let n := ai + 02 and rai,a2 •= cos^"i 0 sin ^"2 standard defini¬ 

tion (—1)!! = 1. Then we have 
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_ J 0 -A ox j odd 

^ I E" =0 OK2m,2n-2m : i = 2ai, j = 202 

Now a case-by-case analysis, using the fact that L 2 n '■= Span{ff 2 «i ('i^i)-f^ 2 a 2 (^ 2 ) ■ ai + a 2 = n} are 
invariant subspaces for C, yields the following for the spectrum of C: 


Eigenvalue 

Eigenfunction 

2A -|- p 

Ajj, i or j odd, i ^ Q 

Er=i CiK 2 i^ 2 n- 2 i where Er=i cTi.n-i = 0 

2A 

Aoj, j odd 

X±,ri 

Er=o K 2 i, 2 n- 2 i and eq. ([31]) 


Remark A. 2. The first row corresponds to functions that belong to the kernels of both Q and P, 
and the second row to functions that belong to the kernels of Q and I — P. 

Here, 

^ _ (2A + fi)± v^(2A + - 8A^(1 - ro,„) 


±,n 

Cn = 


2A 


2A - 


and = 


xT,n 


for i / 0 


(31) 


Using the fact that To^n = ^ cos^^ 9d6 is decreasing in n, it is easy to see that the smallest 

eigenvalue is x~’^. The corresponding eigenfunction is 2 \-x-’^ 3 ^-^ 2 ,o- 


B Appendix: Entropy Bound Optimizer for the Weak Thermostat 


In [2], the convexity of entropy is employed to show that if f{v,t) satisfies 


dt 


v{uf - f) 


where U is the weak thermostat, then dill) holds true. 


We remark here that if (psiv) ■= (1 — 5)Mx{v) + 5My(v), where x 

1— ^-v^/2a 
v27ra 




thereby showing that dllj) is an optimal bound, (ps is a convex combination of Maxwellians, one of 

which approaches the distribution of the heat bath Mi and the other corresponds to a very high 

p 

energy distribution (albeit with a vanishing weight) as <5 ^ 0. These types of functions have been 
used in ESli as examples of distributions that are away from equilibrium (in the sense of the 
entropy) and yet have vanishingly low entropy production (in magnitude). 
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